A Transformation Method for Solving the Hamilton{--}jacobi{--}bellman Equation for a Constrained Dynamic Stochastic Optimal Allocation Problem
نویسندگان
چکیده
We propose and analyse a method based on the Riccati transformation for solving the evolutionary Hamilton–Jacobi–Bellman equation arising from the dynamic stochastic optimal allocation problem. We show how the fully nonlinear Hamilton–Jacobi– Bellman equation can be transformed into a quasilinear parabolic equation whose diffusion function is obtained as the value function of a certain parametric convex optimization problem. Although the diffusion function need not be sufficiently smooth, we are able to prove existence and uniqueness and derive useful bounds of classical Hölder smooth solutions. Furthermore, we construct a fully implicit iterative numerical scheme based on finite volume approximation of the governing equation. A numerical solution is compared to a semi-explicit travelling wave solution by means of the convergence ratio of the method. We compute optimal strategies for a portfolio investment problem motivated by the German DAX 30 index as an example of the application of the method. 2010 Mathematics subject classification: primary 35K55; secondary 34E05, 70H20, 91B16, 91B70, 90C15.
منابع مشابه
An Eigenvalue Approach to Infinite-horizon Optimal Control
A method for finding optimal control policies for first order state-constrained, stochastic dynamic systems in continuous time is presented. The method relies on solution of the Hamilton-Jacobi-Bellman equation, which includes a diffusion term related to the stochastic disturbance in the model. A variable transformation is applied that turns the infinite-horizon optimal control problem into a l...
متن کاملExtracting Dynamics Matrix of Alignment Process for a Gimbaled Inertial Navigation System Using Heuristic Dynamic Programming Method
In this paper, with the aim of estimating internal dynamics matrix of a gimbaled Inertial Navigation system (as a discrete Linear system), the discretetime Hamilton-Jacobi-Bellman (HJB) equation for optimal control has been extracted. Heuristic Dynamic Programming algorithm (HDP) for solving equation has been presented and then a neural network approximation for cost function and control input ...
متن کاملOptimal portfolio allocation with imposed price limit constraint
Daily price limits are adopted by many securities exchanges in countries such as the USA, Canada, Japan and various other countries in Europe and Asia, in order to increase the stability of the financial market. These limits confine the price of the financial asset during all trading stages of any trading day to a range, usually determined based on the previous day’s closing price. In this pape...
متن کاملStochastic Perron’s method for optimal control problems with state constraints
We apply the stochastic Perron method of Bayraktar and Sîrbu to a general infinite horizon optimal control problem, where the state X is a controlled diffusion process, and the state constraint is described by a closed set. We prove that the value function v is bounded from below (resp., from above) by a viscosity supersolution (resp., subsolution) of the related state constrained problem for t...
متن کاملAn explicit solution of a non-linear quadratic constrained stochastic control problem with an application to optimal liquidation in dark pools with adverse selection∗
We study a constrained stochastic control problem with jumps; the jump times of the controlled process are given by a Poisson process. The cost functional comprises quadratic components for an absolutely continuous control and the controlled process and an absolute value component for the control of the jump size of the process. We characterize the value function by a “polynomial” of degree two...
متن کامل